initial reward
R-learninginactor-criticmodeloffersabiologically relevantmechanismforsequentialdecision-making
Afewstudies haveexplored sequential stay-or-leavedecisions in humans, or rodents - the model organism used to access neuronal activity at high resolution. In both cases, decision patterns were collected inforaging tasks-the experimental settings where subjects decide when to leave depleting resources (2).
Methods
We used these rewards to update the network's outputs as follows.
R-learning in actor-critic model offers a biologically relevant mechanism for sequential decision-making
In everyday life we repeatedly face sequential stay-or-leave decisions.